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ABSTRACT 

An evaluation was done of New York City Public 
Schools' Chinese Opportunities in Career Education Program (Project 
CHOICE), which served economically disadvantaged Chinese American 
high school students of limited English proficiency. The project 
operated at two Manhattan high schools and served 523 students, of 
whom 94.6 percent were eligible for the Free Lunch Program. The 
Project was a comprehensive Chinese bilingual program, which 
incorporated business and vocational education with academic 
components. Participants took a full range of bilingual career 
education courses; bilingual contents area classes in mathematics, 
science, and social studies; English as a Second Language (SSL); and 
native language arts. Resource specialists developed Chinese 
bilingual materials, provided classroom teachers with information on 
bilingual and ESL teaching methodologies, gave demonstration lessons, 
held workshops, and served as tutors. The family worker helped the 
guidance counselor and contacted parents. Evaluation of the program 
was based on demographic data, citywide student test scores, and 
interviews with and surveys of the program director. Project CHOICE 
was fully implemented, and it met all objectives. Program strengths 
included its effectiveness as liaison among school staff, students, 
and parents as well as excellent curriculum design for promoting 
students* academic achievement. One appendix summarizes the data 
collection and analysis procedures. (JB) 



a******************************************************** ************ 

* Reproductions supplied by EDRS are the best that can be made 

* from the original document. 



ERH ORE A Report 



Chinese Opportunities in Career Education 
(Project CHOICE) 
Grant Number T003A0022 
1990-91 

FINAL EVALUATION PROFILE 



•■PERMISSION TO REPRODUCE THIS 
MATERIAL HAS SEEN GRANTED BY 



73 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



U S- Of PAHTIiWIT Or IDOCATJO* ^ 

Office of Edwc*f*or** w*s if * piov#*wem 

EO UCAT,ON.^U«C| ( S r O«MAT 1 ON 

Oft0tn«1tnO ft 
Vm»w c*Bf>ge* ^ t**« to wo** 
f©pfoduct*on ow»Wy 

^ do not nec**&a*^ rep*w*»t 
Ot«i pOW«on or pofccy 



M 

^5 



BEST COPY AYMURE. 

_2_ 



* 



Chinese Opportunities in Career Education 
(Project CHOICE) 
Grant Number: T003A0022 
1990-91 

FINAL EVALUATION PROFILE 



ERIC 



3 



NEW YORK CITY BOARD OF EDUCATION 



H. Cart McCall 
President 

Irene H. ImpeUizzeri 
Vice President 

Carol A. Gresser 
Wesiina L. Matthews 
Michael J. Peuides 
Luis O. Reyes 
Ninfa Segam 
Members 

Joseph A. Fernandez 
Chancellor 



DIVISION OF STRATEGIC PLANNING/RESEARCH & DEVELOPMENT 

Robin Winner 
Executive Director 



It it ri» policy of tttffry Yak Cay Bowdof Edaaacc act m 

ftftOOfHi hn^O^lCBppift^ COO^IOOB* J&8V)fl^ fQMBU^ W3B^S} 0 

»d employmem pote*. m required by liw. laqmnoi teprdiat 
Mercedes A. Nando, Dfaerar. Office of Eqtul Opporamny. 110 
Director. Office for Civil Right*. Dep uttu a u of Education. 26 F 



of nee. color, creed, religion, 
or m ■ ia oducMooal propum. icu* i ties, 
wka «pwopri*a law* nay be directed to 
tern. Brooklyn. New York 11201; or to 
33-10. New York. New York 10278. 



■1 



9 

ERIC 



BEST COPY AV/fflffl 



ACKNOWLEDGMENTS 



This report has been prepared by the Bilingual, Multicultural, and Early Childhood Evaluation Unit 

of the Office of Research, Evaluation, and Assessment. 

Additional copies of this report are available from: 

Dr. Tomi Dentsch Berney 

Office of Research, Evaluation, and Assessment 

New York City Public Schools 

110 Livingston Street, Room 732 

Brooklyn, NY 11201 

(718) 935-3790 



FOREWORD 



The body of this report is preceded by ao Extract which presents an overview of salient points of 
the project: funding cycle; enrollment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

The extract is followed by the body of the report, titled Program Assessment . This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by nooinstructional objectives. Hie report then 
addresses those aspects of programming mandated by Title VII regulations tfc; do not have specifically 
stated objectives. This may be information on attendance and dropout rate, grade retention, 
mainstreaming, referrals out of the program to meet special needs of the students, and withdrawals. A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in A ppendix A following the text. 
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Office of Rcjcarcti. EviluMjon, and Awwwpcm 
New York City Public School* 

E.S.E.A. Title VII Evaluation Profile 

Chinese Opportunities in Career Education 

(Project CHOICE) 

Grant Number: T003A80022 
1990-91 

EXTRACT 

PROJECT DIRECTOR: Katberine Sid FUNDING CYCLE: Year 3 of 3 
SUJBS 

High School Borough Grade Levels Enrollment* 

(faU) (spring) 

Seward Park Manhattan 9-12 405 422 

Norman Thomas Manhattan 9-12 32 32 

•The project enroLVd 523 students (97 less than in the previous year), serving 437 in the fall and 454 in the 

spring. 

STUDENT BACKGROUND 



Native Language Number of Students Countries of Origin Number of Students 

Chinese 509 China 460 

Mandarin 66 Hong Kong 32 

Cantonese 402 Taiwan 8 

Fukincse and Vietnam 4 

Toisbanese 41 Other countries 6 

Unreported 14 Unreported 13 



Mean Years of Education in Native Country : 7.3: the United States : 2.2 

Percentage of Students Eligible for Free Lunch Program : 94.6 

ADMISSION CRITERIA 

Program admission was based upon students' scores at or below tne 40th percentile on the Language 
Assessment Battery (LAB), interviews by project director and staff, and placement tests in English as a Second 
Language (E.S.L.) and Native Language Arts (N.L.A.). 

PROGRAMMING 
Features 

Funding for Project CHOICE activities was supplemented by tax-levy and other slate and local funds. 
Project CHOICE was a comprehensive Chinese bilingual program which incorporated business and vocational 
education with academic components. Program students had the opportunity to take a full range of bilingual 
career euueation courses: bilingual content area classes in mathematics, science, socia' studies; FLSX.; and N.L.A. 
Resource specialists developed Chinese bilingual materials, provided classroom teachers with infoimation on 
bilingual and E.S.L. teaching methodologies, gave demonstration lessons, held workshops, and served as tutors. 
The family worker helped the guidance counselor and contacted parents. 



Strengths and Limitations 



The project's strengths included its effectiveness as liaison between school staff, students* and parents, as 
well as the excellent curriculum design for promoting students' academic achievement. Participating students had 
high attendance and a high graduation rate. The project provided services for staff and parents and was the co- 
sponsor of the dtywide Chinese parents conference. The project established a strong materials development 
component and snared its curriculum materials citywide. Project CHOICE made active outreach efforts to the 
community and other schools and districts and organized a variety of cultural activities for students and parents. 
The project provided parents with E.S.L- classes and staff with Chinese (Mandarin) classes. 



CONCLUSIONS AND RECOMMENDATIONS 

Project CHOICE was fuOy implemented. It met all its objectives for E.S.L., N.L_A^ content area 
subjects, career education, attendance, staff and curriculum development, and parent involvement. 



The conclusions, baser on the findings of this evaluation, lead to the following recommendations: 

• If funds permit, tU- project should establish a follow-up program for students who have graduated 
and entered colleg \ 

• If funds permit, the project should add a bilingual guidance counselor to its staff. 
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PROGRAM ASSESSMENT 



STAFFING 



Project director was paid with 



tax-levy funds. 



Title VII Staff (Total 6) 



Title 

BO. Resource Specialist 
Bfl. Resource Specialist 
Bfl. Family Worker 
Bfl. Educational Assistant 
BiL Educational Assistant 
Bfl. Educational Assistant 



Degree 



Language Competencies 



Ph.D. 

M.A. 

B.A. 

B.A. 

B.A. 



College credits 



Chinese 
Chinese 
Chinese 
Chinese 
Chinese 
Chinese 



Other Staff Wo rking with Project Students 

The project reported only partial information about staff working with project students at the participating 
schools. Of 74 teachers at Seward Park High School, all were certified in the subjects they taught. TNey all held 
bachelor's degrees, and more than half of them had advanced degrees (i.e., master's and doctorate). 
Approximately 30 percent of them were proficient in teaching in Chinese. The project did not provide data for 
Norman Thomas High School staff. 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 

En glish as a Second Language (E.S.L.) 

Level Periods Weekly 

Literacy 15 
Beginning 15 
Intermediate 15 
Advanced 10 
Transitional 10 

E.S.L. classes used Phonics for Chinese Students . 

• Program students will make statistically significant gains in English language proficiency. 
Evaluation Instrument: Language Assessment Battery (LAB)' 
Pretest: March 1990; posttest: March 1991. 



'OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was 
normcd. Test scores are reported in Normal Curve Equivalents (N.C.E.s), which are normalized standard scores 
with a mean of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gam in 
N.C.E.S in the absence of supplementary instruction and that participating students' gains are attributable to 
project services. 
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Number of students for whom pre- and posttest data were reported: 280 



Mean gain: 43 N.CEs (s.d.« 7.4) 

Mean gain is statistically significant (t= 9.72, g<.05). 

Project met objective. 



Native Language Art? QUaAJ 

The project offered five periods weekly of Chinese language arts classes (beginning, intermediate, and 
advanced) based upon students' proficiency. One school was in the process of establishing an advanced 
placement (AP) Chinese language class, which would allow participating students to earn college credits. 

• Seventy percent of the participating students will achieve a final grade of 65 or higher. 

Evaluation Indicator Final course grades. 

There were 318 students enrolled in the fall, and 87.4 percent of these passed. In the spring, 276 students 
were enrolled, and 88.0 percent passed. 

Project met objective. 



Content Area Subjects 

Project students took courses in mathematics, science, and social studies, which were taught in English 
supplemented by Chinese. Teachers used the Subject Glossaries (e.g., biology, global and American history). 
Various Chinese supplementary texts were used to help students with mainstream content area curricula, 
including: 

Chinese Supplementary Text for Biology (A.B.C.) 

Chinese Supplementary Text for Understanding the World 

Chinese Bilingual American History Supplementary Ten 

Chinese Supplementary Text for United States History and Government 

At Seward Park High School, new courses were added to meet students' special needs. For instance, four 
bilingual Chinese Introduction to Technology courses were added to the industrial arts curriculum. Seward Park 
High School provided 90 Chinese bilingual classes daily in mathematics, social studies, science, business, and 
performing and visual arts. The project did not report data for Norman Thomas High School. 

• Seventy percent of the participating students will achieve a final grade of 65 or higher. 
Evaluation Indicator: Final course grades. 



passing Grades in Content Area Courses 



Fall 



Soring 



Enrollment 



Percent Passing 



Enrollment 



Percent passing 



Mathematics 
Science 
Social studies 



381 
363 
322 



81.6 
75.2 
84.8 



355 
321 

309 



84.2 
83.5 
84.1 



Project met objective in all subject areas both semesters. 
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Attendance 



• Seventy-five percent of participating students will maintain an attendance rate of above 90 percent. 
By the end of the three-year project period, project students* attendance rate win surpass the rate of 
attendance for each of the two schools as a whole. 

Atteqdapre Rate$ 

Hfeh frftpp) profot ftydems' fote Maiafligaffl SlB&aaC fa* PWerem 

* Seward Park 96.6 832 13.4] 

Norman Thomas 93.9 78.6 153* 

*B<.05 

Project met objective. 
Dropoff, flat? 

Project did not propose an objective for dropout rate. Nineteen, or 3.6 percent, of the project students 
dropped out. However, the rate was lower at both sites than the mainstream students* rate. 

Su pport Services 

Project CHOICE provided academic and personal counseling, college advisement, placement in training 
programs, and career orientation, The staff members contacted families by telephone and mail. 

The project did not propose an objective in this area. 
Siaff Development 

• By the end of the project year, staff members will have attended a total of ten workshops and in- 
service training sessions. 

Staff members attended routine staff development activities in schools (monthly faculty conferences, staff 
development days, and monthly department meetings) as well as 18 professional activities at different levels (city, 
slate, national). 

Project met objective. 

• Five staff members and/or tax-levy instructional staff serving Project CHOICE students will have 
taken credits in bilingual education, career education, computer education, or other subject areas 
related to the goals and objectives of the project. 

During both semesters, eight staff members took 14 different courses in special education, educational 
administration, science, and engineering. 

Project met objective. 
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• By the end of the project year, staff members will have conducted four in-service workshops related 
to the goals and objectives of the project. 

In -service workshops included: 

Materials Simplification for the LEP Students 
Chinatown: Its History and the Community Today 
Chinese Dance 

In-house workshops on a variety of topics for all Chinese bilingual teachers and paraprofessionals 
Project net objective. 



• By the end of the three-year project period, a set of Chinese-English bilingual tape glossaries and 
accompanying booklets will have been developed for all career and technical education courses 
covered by the project 

The project developed glossaries with tapes in occupations, mathematics, global history, computers, and 
biology. The project also prepared a booklet to accompany each tape for students to study at home. 

Project met objective. 



• By the end of the three-year project period, a Chinese bilingual curriculum will have been developed 
for introduction to occupations; business education courses such as reading through keyboarding, 
word processing, accounting, etc.; technical education courses such as electronics, drafting, and 
computer education; and American history. 

The project completed bilingual materials for American history and compiled materials for new courses in 
occupation education. A new curriculum for pre-enginccrii.g was being prepared. In addition, various 
instructional materials were developed in all content areas, 

Project met objective. 



• By the end of the school year, Chinese/English informational materials for students, parents, and staff 
will have been developed. 

The Student Handbook and The Parent Handbook were revised. The project's curriculum development 
staff constructed parent and teacher questionnaires and translated school information as needed by students and 
parents. 

Project met objective* 



Parental Involvement 
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By the end of the project year, more than 130 parents will have attended the project's fall and spring 
parent-teacher meetings. 

By the end of the project year, 90 percent of the parents who participate in the parents' ELS.L 
workshop will indicate that they have improved their English a great deal 

By the end of the three-year project period, parents will have participated in the Parents' Advisory 
Committee and will have taken an active role in policy decisions regarding planning, organization, 
and implementation of program activities. 

6 
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A total of 155 parents attended two parent-teacher meetings in the fall Despite severe weather, the 
annual Sunday Project CHOICE on April 21 attracted 50 parents. Approximately 60 parents of partkipaling 
students attended each of the four parent-teacher conferences. These meetings provided oarents with information 
about the school system, graduation requirements, and their rights as parents. Participants also discussed 
differences between the cultural and educational systems of the United States and those of their native countries. 

The project staff conducted a large-scale needs assessment survey among the parents of 1,090 Chinese 
bilingual students. Parents completed a questionnaire at the end of the spring semester and indicated that they 
bad improved in English after attending the parent E.SX. workshops. The adult educatku classes provided 
parents with opportunities for literacy instruction in English and an effective forum for discussi ng rotes and 
responsibilities in their children's education. 

Parents were on the Assistant Principal Selection Committee and the schoohvide Parents Executive Board. 
Nine parents participated in the New York State Bilingual Education Conference (SABE) Parents Institute on 
March 9, 1991. 

Project met objective. 



STUDENTS WITH SPECIAL ACADEMIC NEEDS 



Number of Students PercentaEe 

Referred to special education: 1 02 

Referred to remedial programs: 0 0.0 

Referred to gifted and talented programs: 0 0.0 
Retained in grade: 0 0.0 



Teachers and project staff initiated recommendations and referred students who seemed to have special 
needs to a Chinese bilingual guidance counselor. With parents* permission, they also referred students to the 
School-Based Support Team (S.B.S.T.) for further testing to identify their needs for special education. The 
project itself, however, did not provide services to handicapped students or those considered gifted and talented. 



MAINSTREAM1NG 

No students were fully mainstreamed this year. 
Academic Achievement of Former Project Students in Mainstream 

The project did not provide data on former program participants. 
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case HKHPRIES 



1. Zbe Z. came to the United States from Canton, China in 1988, when be was 16 yean old. His parents 
bad enjoyed a relatively stable life in China; his father, a graphics designer, and mother, an elementary school 
teacher, did not need to leave their native country for economic reasons. Yet, like many Chinese immigrants, 
they decided to come to the United States for the future of their children. 

Zbe had finished the ninth grade in China. He was only a fair student. When he arrived in this couni 
he barely knew English. However, in three years, with the encouragement of his parents and the help of the 
bilingual education program, Zbe achieved an overall average of 95. He has received numerous honors from the 
school and from outside agencies, both for service and for academic achievement, particularly is mathematics. 
His name was placed on the New York City Public School's "Chancellor's Honor Roll." Most recently, he won a 
first-place scholarship given by the New York State Association for Bilingual Education. 

Besides being an academically superior student, Zhe is very active m the school's extracurricular activities, 
such as the Chinese Culture Club, the Math Team, the Computer Team, the Ham Radio Club, and U»e French 
Club. 



2. Qiang Z. was born in southern China, in the area of Toishan, in 1971. Her schooling in China had 
stopped after the fifth grade. She came to the United States in 1987 when she was 16 years old. Her parents did 
not speak any English. Her father worked in a restaurant and her mother worked in a factory. 

When Qiang was admitted to Seward Park High School, she was placed in the Native Language Arts 
program for students who were not literate in their native language and also did not know any English. Four and 
one-half years later, she graduated. Her average of 77.8 has earned her t rank of 182 in a graduating class of 405 
students. She also participated in the Executive Internship Program, demonstrating her business ability while 
improving her English. She planned to attend Brooklyn College and major in accounting. 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 



Student Data Fqrm 

This one-page fonn is filled out by staff for each participating and mainst reamed student. OREA gathers 
data from this form on backgrounds, demographics, academic outcomes, attendance, referrals, and exit from the 
program, 

Project Director's Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program imnementation, 
periods of instruction, and instructional materials and techniques. 

Project Director's Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire. Hie interview also allows project staff to offer qualitative data or amplify 
responses to the Questionnaire. 

Cilvwide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other citywide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.CE.S). N.C.E.s are 
normalized standard scores with a mean of 50 and a standard deviation (s,&) of 21. 06. They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.CEs is the same 
whether it is at the lower or the higher end of the scale. N.C.E.s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert-Tvpe Surveys 

Liken-type surveys, in which respondents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops and other 
activities. 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficiency 
(LEP) are entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the lest was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. 
(Sec "Citywide Test Scores* above.) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a 
t-test. To determine whether a difference between two proportions (e.g., program and mainstream attendance 
rates) is greater than could be expected by chance, OREA uses a z-test. The level of significance is set at .05 fci 
all tests. 
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